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Abstract. - The origin of scale-free degree distributions in the context of networks is addressed 
through an analogous non-network model in which the node degree corresponds to the number of 
balls in a box and the rewiring of links to balls moving between the boxes. A statistical mechanical 
formulation is presented and the corresponding Hamiltonian is derived. The energy, the entropy, 
as well as the degree distribution and its fluctuations are investigated at various temperatures. 
The scale-free distribution is shown to correspond to the degenerate ground state, which has small 
fluctuations in the degree distribution and yet a large entropy. We suggest an implication of our 
results from the viewpoint of the stability in evolution of networks. 



Complex networks have undergone a rapid surge of interest and a number of review 
articles already exist [1,2]. A striking observation in this field is that many real networks 
have a broad scale-free like degree distribution. Why is this and what does it imply for the 
evolution mechanism of the networks? The preferential attachment [3] has been proposed 
as such a mechanism, where the scale-freeness is directly linked to the growing number of 
nodes in the network: once a link is in place it stays in place. This model mechanism has 
become a successful prototype explanation in many cases [1,2]. In the present context, it 
corresponds to the extreme limit with only growing and no rewiring of links [4] , whereas the 
opposite extreme is no growing and only rewiring. The fact that also the latter extreme can 
lead to scale-free degree distributions was explicitly demonstrated by the discovery of the 
merging-type evolution [5,6], or the non-growth network model [7]. Furthermore, one can 
devise a scale-free evolution as an in-between of these two extremes. For example, you can 
combine slow growing with the merging type evolution and still get scale-free distributions [5] 
and you can combine preferential growing with deletion of nodes and also get broad degree 
distributions for somewhat less fast growing networks [8]. However, the distinction remains: 
In the one case the scale-freeness is linked to the network growing process and in the other 
to the rewiring of links. 

In the present Letter, we try to get a better understanding of scale-freeness through 
rewiring by using a statistical mechanical formulation, applied for a non-network model 
without growing. We characterize this model in terms of a ground state energy, a tempera- 
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ture, and an entropy. It is found that the scale-free distribution is unique in the sense that 
it combines small deviations from the average degree distribution with a high entropy, or 
equivalently a large number of available states. 

Our model consists of N "towns" (=boxes) with the total of N(k) "inhabitants" (=balls) 
with (k) being the average number of inhabitants per town [9]. We assume that a randomly 
picked person A chooses a person B randomly and then moves to the _B's town with a certain 
probability. The rate of moving from a town with k\ inhabitants to one with ki inhabitants, 
R(ki,k2), is assumed to be separable, i.e., R(k\,k2) — g(k\)f{k2), which means that the 
attraction or repulsion of a town of a certain size is the same for all people. The question 
is then what distribution of town sizes this leads to in a steady state. There is a one- 
to-one correspondence between this model and a corresponding network: The inhabitants 
corresponds to link-ends so that each link is associated with two specific persons. The 
link-ends are randomly chosen and randomly moved to other link-ends and attached to the 
same node. However, in networks one usually also introduces the topological constraints 
a) the network is connected, b) only one link connects two different nodes, and c) no link 
starts and ends on the same node. In practice these topological constraints only introduces 
significant statistical differences between the network and the town model for the case when 
the random rewiring in steady state leads to nodes with of order N(k) inhabitants [10]. 

The probability P(k,t) that a town has k inhabitants at time t evolves following the 
master equation 

N ^dT~ = -HKt)f{k) + Hk-i,t)f{k-i) 

-T{k,t)g{k)+T{k+l,t)g{k + l), (1) 

where T(k,t) = kP(k, i)/Efc kP(k,t)] = kP(k,t)/ (k) is the probability of choosing a person 
from a town of size k. The two terms with the negative signs in Eq. (1) describe the decrease 
of P(k) when a person moves in and out of a town of size k, respectively. Note that this for 
a network corresponds to rewiring one link at a time [11]. The two functions f(k) and g(k) 
are required to satisfy the condition ^2 k kP(k)f(k)/ (k) = J2 k kP (k)g(k)/(k) = 1 in order 
to ensure that precisely one person on the average moves at each time step. The second 
and the last terms correspond to when a person moves from and to a town of size k + 1 and 
k — 1, respectively, which increase the inhabitants in the towns of size k. From the steady 
state condition together with the normalization conditions one obtains the detailed balance 
conditions for f(k) for moving into a town, and g(k) for moving out of a town. There is in 
fact only one possibility: 

/<*) = for*>l, ,2, 



P(l) 
(fc) 



kP(k) 



9(k) = _V m forfc>2, (3) 

and /(0) = and g(l) = 0. In this model, a sole inhabitant is not allowed to leave the 
town [g(l) = 0], and you never move to an empty town because there is none to encounter 
[/(0) = 0]. We stress that Eqs. (l)-(3) constitute the only possibility under the given 
assumptions. 

The next step is to choose an update rule which is consistent with the above conditions: 
We start from two random persons A and B. Suppose that A (B) lives in a town of 
size k\ (^2). We then also randomly choose two persons C and D who live in towns of 
size ki + 1 and ki — 1, respectively. A possible update rule is that A either moves to 
B's town or C moves to D's town. We know from the detailed balance that the number 
of A's moving to _B's is on the average equal to the number of C"s moving to D's. The 
probability for A to move to B's town using this update is given by jr^r^^^j) an d 
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the probability for C moving to D's town is then f^j^f^-i) . The latter probability 
is then within this update rule equivalent to A not moving to B. Next, one notes that 
if we refer these two probabilities to moving or not moving A to P's town, respectively, 
then detailed balance is in fact automatically fulfilled. So our particular update rule is 
equivalent to randomly choosing two persons A and B and then moving A to B's town 
with the probability jp^jq^j^rrq ■ The relative probability for A to move or not to move 
to B's town, respectively, can consequently be expressed in terms of the Boltzmann-type 
factor e in/(fc2)-in/(fei-i)_ We rewrite tn i s as e ~ AE with AE^ 2 = m/(fci - 1) - ln/(fc 2 ) = 
lnfciP(fci) - ln(fci - l)P(fci - 1) - [ln(fc 2 + l)P(k 2 + 1) - \nk 2 P(k 2 )] which is equivalent to 
assigning the energy e(fc) = X^=i[ m (^W) ~ l n ((* ~~ ~ 1))] — m kP(k) to a town of 

size k. This means that the total energy of the Town model is 

E = -Nj2 p ( k )HkP(k)}, (4) 

fe=i 

where NP(k) is the average number of towns with k inhabitants. We note that this implies 
that any predetermined distribution P(k) can be recovered from a Monte Carlo (MC) algo- 
rithm with the canonical distribution e~ E / T with T = 1 and E = — -^X\=i n (k) ln[fcP(fc)], 
where Nn(k) is the number of towns with k inhabitants [12, 13]. The point in the present 
context is that E is the Hamiltonian for a given fixed P(k) which yields the correct average 
energy (E) = E = --/V£fc=i P(k) ]n[kP(k)]. 

We also note that the relation between the entropy S and the probability distribution 
P(k) applies to the present case of a fixed number of people N(k) living in N towns: There 
are then N\ ways to associate a given sequence of N different labels with a town. However all 
towns with the same k are equivalent. So the number of different states are N s = Uk (NP(k))\ 
which by Stirling's approximation gives the entropy 

S = -N^2P(k)\nP(k). (5) 

k 

This means that there is a one-to-one correspondence between P(k) and 5*. Thus we can 
change variables and instead of keeping P(k) fixed we keep S fixed. 

In order to find the extremum corresponding to these constraints we need three La- 
grangian multipliers a, 6, and c corresponding to normalization condition for P, constant 
average number of people per town (k) , and constant entropy S. Thus in these variables the 
detailed balance condition determines P(k) via the minimization of the functional [14] 

G[P] =5^P(fc)pnfcP(fc)+a + &fc-clnP(fc)], (6) 
k=l 

In P(k) +lnfc + l + a + 6fc — cln P(k) — c = and hence the solution 

P(*) = ^3!L*A) (7) 

with 7 = 1/(1 - c), A = (1 - c)/b, and A = exp(l - o/(l - c)). We stress that Eq. (7) 
is unique and thus covers all possible solutions for the detailed balance equation of the 
form Eq. (1) except solutions with order N(k) inhabitants and other discrete solutions 
which fall outside variational calculus (see below). In order to finish the translation into a 
statistical mechanical formulation we observe that each of the possible solutions correspond 
to different free energies. In statistical mechanics such solutions correspond to different 
temperatures T. The solution for T = is the ground state and hence the absolute minimum 
of G[P(k) — .A cxp fr^^ ] with respect to the variables A, A, and 7. Minimization of G[P] 
in Eq. (6) gives the ground state solution P(k) = Ak^ 70 with A and 70 determined from 

p-3 



P. Minnhagen et. al. 




Fig. 1: Energy H(T) and entropy S(T) as a function of T for the town model. For T = the 
entropy is finite which means that the ground state is degenerate. As T increases from to oo, the 
entropy only increases slightly, which means that the ground state has almost as many available 
states as at T = oo. On the negative-temperature side from T = — oo to T — — the energy 
increases whereas the entropy decreases since the number of available states decreases. (Note the 
cuts and shortenings of the horizontal and vertical axes.) 



the normalization and the constant (k) condition. Or, in other words 7o((&}) is a unique 
function of the average town population (k). Consequently, the Hamiltonian which gives 
the correct ground state is uniquely given by 

H = N Vn(/c) f — lnn(fc) -f-lnfc). (8) 

where Nn(k) is the number of towns with k inhabitants. (Note that the term ^2 k=1 n(k)[a + 
bk] has been dropped because it does not depend on n{k)). The statistical mechanics is 
specified by the Boltzmann factor given by exp(— H/T). The point is now that each one 
of the solutions P(k) — ^ cx p^/ a ) are recovered as an statistical mechanical equilibrium 
solution; one for each temperature T . This completes the statistical mechanical formulation 
of the town model. This formulation is in accord with the entropy-maximum formulation by 
Jaynes [15] in the sense that the solution we obtain for each given T contains the maximum 
unbiased information you can have subject to the imposed constraints. 

In Fig. 1, we plot the energy and entropy as functions of T: Both increase from T = to 
T = oo, while from T = — oo to T = —0 the entropy decreases but the energy increases. The 
corresponding distribution of town sizes are illustrated in Fig. 2: It varies from the scale-free 
distribution with A = at T = and then narrows to the totally random distribution with 
7 = 1 and A > at T = ±oo. On the negative-temperature side it continues to narrow 
down to T = — 0. We stress that the Hamiltonian H in Eq. (8) is the only Hamiltonian 
which contains the complete spectrum of possible solutions consistent with the detailed 
balance condition for the corresponding average distribution P(k) Eq. (1). Also note that 
the Hamiltonian (8) includes the discrete solutions (which cannot be obtained directly from 
variational calculus). 

From a dynamical point of view the town model evolves in time according to a Metropolis 
MC dynamics: At each time step a random person chooses another random person and 
moves or does not move to the town of the latter person according to a rate which depends 
on the energy difference given by the Hamiltonian. The point we are making is that this 
formulation combines maximum randomness with detailed balance [16,17]: Provided that 
the only constraint is the detailed balance given by Eq. (1), then our description is unique and 
connects each solution P{k) — (n(k)) with the corresponding averaged fluctuations in time 
A(fc) = yj (n(k) 2 ) — (n(k)) 2 . Alternatively expressed: Our Metropolis algorithm defines the 
unique random rewiring process which gives rise to the average degree distribution P{k) 
defined by Eq. (1). 

Although Eq. (1) is a quite general form of detailed balance, it does not cover all possi- 
bilities. This is because there are alternative ways to introduce the randomness. A second 
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Fig. 2: Distribution of town sizes P(k) as a function of T for N — 1000 and 70 = 2.5 which gives 
(fc) = 1.56. (a) For T ~ the distribution is scale-free, (b)-(c) As T increases from to 00, the 
scale-free distribution gradually changes to P(k) ~ exp(— k/X)/k. (d)-(e) As the temperature is 
increased through —00 to —0, the distribution continues to narrow and finally approaches as much 
as possible the single-sized town state in (d), where the vertical dashed line denotes the solution at 
T = —0 of the single-sized towns of the size (k) = 1.56. The solution for T — —0.5 is for practical 
purposes very close the the ER-solution denoted as a dashed curve in (d), for which the boundary 
condition P(0) = is used in the ER-calculation for the purpose of comparison, (f) Comparison 
for the case of N = 100 and (k) = 4 between P(k) at a negative T and the ER distribution: As a 
larger value (k) = 4 is used, the difference is somewhat larger than in (d) for (k) = 1.56. 



possibility is to instead choose a random person and then a random town. This is described 
by the Hamiltonian H = N n(k) In fc!, and the corresponding distributions goes from 
single sized towns at T = to the ER(Erdos-Rcnyi) distribution at T = 00 and continues 
towards the maximum entropy state P(k) ~ exp(— fc/A) on the negative-temperature side 
until it collapses to a discontinuous star-type distribution [18]: From a statistical mechan- 
ical point of a view the system collapses from a low-energy and high-entropy state via a 
first-order transition to a high-energy and low-entropy state [18]. The third obvious possi- 
bility is to choose two random towns, which only gives the trivial maximum entropy state 
P(k) ~ exp(— k/X). We also note that our randomness "random person to random person" 
is reminiscent of preferential attachment since choosing a random person is equivalent to 
choosing a random town with a probability ~ kP(k) and then choosing one of its inhabi- 
tants with probability 1. We note that distributions which are approximately of the ER-form 
are obtained for a negative T in case of the random-person-to-random-person Hamiltonian 
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Fig. 3: (a) Fluctuations A(T) as a function of T. As T — ► +0 the fluctuations vanish and the 
distribution P(k) becomes scale-free, (b) The fluctuations A(fc) as a function of the town size k for 
a variety of distributions P(k). 



as shown in Fig. 2. The deviation comes for the largest towns as is further illustrated in 
Fig. 2(f). The point here is that it is in practice difficult to distinguish between various 
random processes on the basis of only the distribution P(k). 

Our investigation of the town model suggests that the deviation, A(fc), from the average 
distribution during a steady state process (or more generally any evolution process) is an 
essential and informative characteristics of a network which complements the average dis- 
tribution function P(k). In Fig. 3(a) the total noise A = ^ fc A(k) is plotted as a function 
of T for the town model. The most striking feature is the vanishing of A as T — > +0, which 
means that the deviation from the average P(k) goes to zero. In the same limit P(k) becomes 
scale-free and the number of available states is large, as discussed in connection with Figs. 1 
and 2. As T increases the noise also increases and goes through a maximum before it drops 
to zero when the number of available different states decreases to a number of order one. 
Figure 3(b) gives some examples of A(fc) as a function of town size for some distributions: 
"The smaller T the smaller A (fc)" -connection is illustrated by the scale-free distribution for 
T = 0.05 and (k) = 2 in Fig. 3(b). This is compared to the corresponding result for the 
preferential attachment, which gives the same P{k) but a larger noise. In a similar way the 
large noise case for the ER-like distribution at T = 0.51 and (k) = 4 is compared to the 
noise of the corresponding true ER-distribution (see Fig. 2(f)). As seen from Fig. 3(b) both 
have large deviations from the average distribution, although the ER-deviation is somewhat 
smaller. 

We have shown that the detailed balance under rather general conditions leads to a 
unique equilibrium Hamiltonian which connects the distribution function P{k) to a fluc- 
tuation distribution A(k). In principle, this means that given a distribution P(k) the 
corresponding fluctuation distribution will tell whether or not the dynamics of the sys- 
tem is consistent with detailed balance under the specified conditions. Thus the fluctuation 
distribution A(fc) is a characteristics which complements the average distribution P(k). Pre- 
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liminary tests on some real networks suggest that this might be a useful characteristics in 
practice [18]. In addition, we have shown that the ground state of the Hamiltonian for the 
town model is the highly degenerate scale-free distribution. This state is characterized by 
many possible states combined with very small fluctuations. We speculate that, in as far as 
large changes and fluctuations might be fatal and many different possibilities beneficial for 
the evolution of a system, the scale-free distribution might sometimes be an evolutionary 
winner. 
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